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Queues arising in buffers due to either random interruptions of the 
channel or variable source rates are analyzed in the framework of a single 
digital system. Two motivating applications are: (i) multiplexing of data 
with speech on telephone channels and (ii) buffering of data generated by 
the coding of moving images in Picturephone® service. 

In the model a source feeds data to a buffer at a uniform rate. The 
buffer's access to a channel with fixed maximum rate of transmission is 
controlled by a switch; only when the switch is closed ("on") is the buffer 
able to discharge. The on-off sequence of the switch is indicated by a 
burst process which is a key element in this paper. In such a process, 
long periods during which the switch stays closed alternate with periods, 
called bursts, during which the on-off sequence is a first-order Markov 
process. The length of a burst is randomly distributed. This is a general- 
ization of the memoryless burst process considered in an earlier paper. 1 
In that paper we gave formulas for the efficient computation of various 
functionals of the queues arising in the system. Now we extend these 
formulas to hold for the generalized class of burst processes. 

I. INTRODUCTION 

In a recent paper 1 we considered the problem of buffering the output 
of a uniform source whose access to a given transmission channel is 
controlled by a burst process. We gave formulas for efficiently com- 
puting various functionals of queues that form in such a communica- 
tion system when the controlling burst process is memoryless. 

In the present paper we generalize the controlling process to one 
which is first-order Markov within a burst. This generalization con- 
siderably increases the usefulness of the formulas. Consider, for ex- 
ample, the two motivating applications discussed in Ref. 1 : (i) multi- 



* The sequence of names was decided by coin tossing. 
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plexing of data with speech on telephone channels 2-6 and (it) buffering 
of data generated by the coding of moving images in PicturephoneP 
service. 7 For the first application, analysis of data shows 2 that it is 
necessary to go to a first-order Markov process to adequately model 
the burst phenomena in speech signals. In the Picturephone applica- 
tion, although the correlation of data rates within a frame is negligible, 
it is quite significant from frame to frame. 8 For frame-to-frame coding, 
therefore, the present model with memory becomes necessary. 

The system under consideration is shown in Fig. 1. The source emits 
data uniformly at the rate of 1 symbol per unit time. The transmission 
rate of the channel is (A; + 1) symbols per unit time, where k is some 
positive integer. The on-off pattern of the switch is indicated by a 
binary burst process: E(j) is either or 1 for j = 0, 1, 2, • • •. If 
E(j) = the switch is closed for the time duration [j, j + 1) ; other- 
wise, the switch is open. We assume that there are long periods during 
which E(j) = and that at the end of every such period the buffer is 
empty. The activity separated by such periods we call a burst. We 
assume bursts to be independent of each other, and the burst length 
to have a probability distribution which is either geometric or is a 
weighted sum of geometric distributions. Within a burst, [E(f)} is 
assumed to be a homogeneous two-state M arkov chain with transition 
probabilities 0i and 2 given by 

X £ Prob. [E(j + 1) = l\E(j) m 0} (la) 

2 £ Prob. [E(j + 1) = 0\E(j) = 1}, j - 0, 1, 2, • • •. (lb) 

These two parameters completely specify the Markov chain; the 
probabilities of the other two possible transitions are, of course, given 

by 

1 - $ x - Prob. \E(j + 1) = 0\E(j) = 0} 
and 

1 - 0, = Prob. [E(j + 1) = l\E(j) = !}• 

We shall assume that < B x < 1 and < 9» < 1. If 0i + 9% « 1, B t 

becomes a Bernoulli sequence of independent random variables, which 
is the case treated in Ref. 1. 

In subsequent sections of this paper we will obtain the results sum- 
marized below. 

In (i), (ii), and (m), we assume the switch to be controlled by an 
infinitely long sequence generated by the Markov chain described by 
(1) ; these three results are therefore of interest in situations where the 
distribution of burst lengths is not known accurately. 
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Fig. 1 — S witched communication system. 

(i) We derive a recursive formula for the steady-state distribution 
of buffer content for finite buffers, the recursion being with respect to 
the buffer size, N. 

(ii) Let T (,V) be the steady-state probability of a buffer of size N 
being full when the channel is inaccessible. (T° v >, therefore, is the 
steady-state probability of a transmission fault.) We show that 
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where (k + 1), as previously defined, is the transmission rate of the 
channel. We show that the steady-state probability of the buffer 
being full is T lN) /(l — #2), and therefore satisfies the same recursive 
relation. 

(in) For a buffer of size greater than N, let F (X) denote the mean 
time to first passage through the level N. We show that F lN) satisfies 
the recursion 
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The next two results are of interest when the distribution of burst 
lengths is well-approximated by a weighted sum of geometric 
distributions. 

{iv) Let G {N) be the probability of overflow for a buffer of size N 
during a burst. Then if the burst lengths have a geometrical prob- 
ability distribution with parameter pji.e., Prob. (burst length = i) 
= p ,-1 (l — p)\, we show that 
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This result generalizes to the case when the burst length distribution 
is a sum of geometric distributions. 

(v) We derive a closed expression as well as a recursive formula for 
the mean time for first passage through a level N during a burst 



FORMULAS ON QUEUES— II 427 



conditioned on the occurrence of an overflow. The recursion is with 
respect to N, and the bursts are assumed to be distributed as in (iv). 
(vi) We determine the asymptotic behavior of all the formulas 
in (i) to (v) as N — * « . For instance, we prove that, as N — > °o , 
(l/G (N) ) ~ s N , where s is the unique positive real root of a particular 
polynomial, such that s > 1/p > 1. 

The closed expressions are all valid for k ^ 1 and N ^ 0, and the 
recursions as stated above are valid for N ^ 0. The recursive formulas 
provide very efficient means for computation of the various functionals, 
particularly in design studies where a whole range of buffer sizes is to 
be investigated. 

1.1 Notation 

Whenever necessary we will use a superscript in parentheses, e.g., 
x {M) , to indicate that the quantity corresponds to a buffer of size M 
(or to the level M in a buffer of size greater than M). If x is a vector, 
then the superscript (M) will also indicate that the vector x (Af) is 
{M + l)-dimensional with components x\ M) , i = 0, 1, 2, • • •, M. These 
two uses of the superscript are consistent because the dimensions of 
all vectors defined in this paper are related to buffer size (level) in this 
manner. Whenever the superscript is missing, the standard value (N) 
will be implied. 

We will use lower-case boldface letters to denote column vectors, 
upper-case boldface letters to denote matrixes, and a superscript T to 
denote the transpose. We will denote by I the identity matrix, by 1 
the vector whose components are all equal to 1, and by e> the vector 
whose jth component is 1 and the rest 0, e.g., e^ = (1,0, • • •, 0). 

II. EQUATIONS OF THE PROCESSES 

Let B(t) be the number of symbols in the buffer at time t. Then for 
a buffer of size N 

B(t + 1) = Max [B{t) - k, 0] if E{t) = (2a) 

= Min [B(t) + 1, N] if E(t) = 1. (2b) 

In the last equation the assumption is that if the channel is inaccessible 
and the buffer is full, then the current source symbol is discarded and 
the buffer remains full. 

In order to study the evolution of the buffer content process, it is 
convenient to introduce two (N + l)-dimensional vectors p(J) 

428 THE BELL SYSTEM TECHNICAL JOURNAL, MARCH 1974 



= [po(t), •••, pir(t)\ and q(t) = [q„(t), ■■■, q N (t)\ denned by the 
equations 

Pi (t) = Pr \B(t) = i, E{t) = 0}, i = 0, • • ., N (3a) 

g<(«) £ Pr j5(0 = i, E(t) = 1], t - 0, - - -, tf. (3b) 

Under the assumption that \E(t)} is the two-state Markov chain de- 
fined by (1), it is straightforward to show that p(t) and q(0 represent 
a 2(iV + l)-state homogeneous Markov chain. For 

po(t + 1) = Pr [B(t + 1) = 0, E(t + 1) = 0} 

= Z Pr \B(t) = i, E(t + 1) = 0, E(t) = 0} 
«-o 

= L Pr {E(t + 1) = 0\E(t) = 0, 5(f) = i\ 

X Pr [B(t) = i,E{t) = 0) 

- (i - e 1 ) £ Pi (t), (4) 

i-0 

where the last step follows from the Markov property of { E (t) \ . 
Similarly, 

Pi (t + 1) = (1 - d 1 ) Pi+k (() + B 2 qi-i(t), i = 1, 2, • • -, N - k, 
= e 2 qi-i(t), i = N - k + 1, • • ♦, N - 1, 

-»i{ff«-i(0+«Jf(*)}, *' = #■ (5) 

Also 

ffi« + 1) - ft £ Pi(0, i = 0, 

7-0 

= d lPl+k (t) + (l - fc)9<-i(t), i = 1, 2, - ■ -, N - k, 

= (1 - 02)<7.-i(O, i - AT - fe + 1, • • •, N - 1, 

= (1 -e 2 ){qi-i(t) +9.(01, * = #■ (6) 

Equations (4), (5), and (6) can be written conveniently in matrix 
notation as 

p(J + 1) = (1 - 0i)Bp(«) + 0>Zq(O (7a) 

q(/ + 1) = 0,Bp(O + (1 - 2 )Aq(O. (7b) 
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Here the (N + 1) X (N + 1) matrixes B and A are denned as 
(* + l) 



n i-i 
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(8) 



Notice that the composite matrix 

f (l - e 1 )B 



hB 



2 A 

(i - e 2 )X 



(9) 



is stochastic (nonnegative elements and every column sums to 1) and 
independent of t. Equations (7a), (7b) are, therefore, the transition 
equations of a 2(N + l)-state homogeneous Markov chain. 

2.1 Equations for some new probabilities 

For many of the derivations in the succeeding sections (e.g., mean 
first passage time, probability of no overflow, etc.) it is convenient to 
define certain new probabilities rt(t) and s,(i), » ™ 0, 1, • ■ -, N. Con- 
sider a buffer of size greater than N and let X(t) be the event 
flUo \B(s) ^ N], i.e., the event that B(s) does not exceed N at any 
of the time instants s = 0, 1, 2, ■ ■ -, t. Then 

n(t) = Pr \B(t) = i, E{t) = 0, X(t)\, i = 0, • • ., N, (10a) 

8i (t) = Pr \B(t) - i, E(t) = 1, X(t)\, i = 0, • • -, N. (10b) 

We define the (JV + l)-dimensional vectors r(0 and s(t) with com- 
ponents MO, ■ • -, r N (i)\ and \s (t), ■■-, s N (t)\, respectively. 

In a manner analogous to the derivation of eqs. (7a) and (7b), 
we can derive recurrence relations giving r(J + 1), s(l + 1) in terms 
of r(<), s(0- Thus, for i = 0, 1, • • -, N, 

ri (t + 1) = Pr \B(t + 1) = i, E(t + 1) = 0, X(t + 1)| 
- Pr{B(t + 1) = i, E{t + 1) = 0, X(t)\ 
= (1 - Ox) Pr \B{t + 1) = i, £(0 = 0, X(*)j 

+ 2 Pr {£(* + 1) = i,tf(fl = l,X(t)\, (11) 

where the last equation follows from the Markov property of \E{t)\. 
As before, B(t + 1) and £(<) determine the possible values of B{t) 
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and we get 

n(i + 1) = (1 - Oi) £ rj(t), i = 0, 

3=0 

= (1 - 0i)r,- +Jk (O + 02S,-i(<), * = 1, 2, • - -, N - k, 

= e&i-i(t), i = N - k + 1, • • •, iV. (12) 

Comparison of eq. (12) with eqs. (4) and (5) shows that for 
t = 0, 1, •••, 

r(/. + 1) = (1 - 0OBr(O + 2 As(O, (13) 

where A is obtained from A by setting to the single nonzero entry 
on its main diagonal, i.e., 

A = A - e N e£. (14) 

Analogously to (13) we can also show that 

s(* + 1) = 0iBr(O + (1 - 6 2 )As(t). (15) 

The transition equations (13) and (1-5), although very similar to 
eqs. (7a) and (7b), differ fundamentally from them in that A, and 
consequently the matrix 

|_ X B (l-0 2 )A_j' ^ 

are not stochastic. 

We close this section by deriving from (13) and (15) a useful second- 
order recursion involving s(/ + 2), s(t + 1), and s(t). Multiplying 
(13) by 0i, (15) by (0i - 1), and adding we get 

0,r(/ + 1) = (1 - 0i)s(* + 1) - (1 - 0i - 2 )As(O- (17) 
From (15), 

s(t + 2) - 0iBr« + 1) + (1 - d 2 )As(l + 1). (18) 

Premultiplying (17) by B and adding to (18) gives 

s(/ + 2) = [(1 - 0i)B + (1 - 2 )A>(/ + 1) - (1 - 0i - 2 )BAs(O, 

t = 0, 1, 2, .». (19) 

As we will have to refer frequently to the recursion (19) it is convenient 
to define 

C = [(1 - *i) B + (1 - 02)A] 
and (20) 

D = - (1 - 0i - 2 )BA 
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so that eq. (19) becomes 

s(t + 2) = Cs(f + 1) + Ds(0, t = 0,1,2, ■■-. (21) 

III. INFINITELY LONG SEQUENCES 

When the burst length distribution is not known, useful information 
can still be obtained by considering the behavior of the buffer content 
when the switch in Fig. 1 is controlled by infinitely long sequences 
generated by the Markov chain (1). In this section we derive various 
functionals for such a situation. 

3.7 Stationary distributions for finite buffers 

In eqs. (7a), (7b), if we set p(« + 1) - p(0 = p and q(t + 1) 
■ q(0 = <1> then the vectors p = \po, ■ ■ ■ , Pn\ and q = {p , • • • , <?#} 
give the limiting distributions 9 as t — > <x> of the buffer content process 
defined in Section II. The limiting distributions p, q are thus the solu- 
tions of 

p = (1 - 0OBp + 2 Aq (22a) 

q = 0!Bp + (1 - 2 )Aq (22b) 

with, of course, the normalization 

l r (p + q) = 1. (23) 

In this section we derive a simple formula for computing the vectors 
p and q for a given buffer size (iV + 1) in terms of p and q for a buffer 
of size N. As a first step we simplify the problem by eliminating p from 
eqs. (22a), (22b). Multiplying (22a) by $i and (22b) by (fli - 1) and 
adding gives 

•-(t*)'- 1 ^* (24) 

Substituting (24) into (22b) gives 

[I - (1 - 0i)B - (1 - 2 )A + (1 - 0i - 2 )BA]q = 0. (25) 
Premultiplying (24) by l r and subtracting from (23) gives 

^ - aTTT, (26) 

since l r A = l T . It is important to note that the N + 1 component 
equations in (25) are not independent. Indeed, since l^A = 1H3 = l r , 
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it is clear that the first equation is just the sum of the rest and may 
therefore be ignored. The remaining N equations are linearly inde- 
pendent and we can solve them for q , • • • , qx-i in terms of qN, and 
then obtain q N from (26). Finally, we can obtain p from (24). 

In carrying out the solution of (25) and (26) in this manner the 
recursion we are looking for becomes obvious if we define the (N + 1)- 
dimensional vector y (V> with components given by* 



yi m = q^-i/q^, i = 0,--,N. 



(27) 



[The meaning of the superscript (N) is given in Section 1.1.] Equations 
(25) and (27) give 



2/o — 
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1 - 



(28a) 
(28b) 

(28c) 

(28d) 
i 

-y£\-i, t > A + 1. (28e) 



The important fact about (28) is that the superscript (N) is superfluous. 
If N is changed to N + 1, for instance, in (28) we see that 



yt — 2/- , 



i = 0, ••-,#, 



and the last component of r/<- Y+1 > is 
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'2 fV) 
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'1 ,.(-V) 
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(30) 



Thus the vector y (V+1 > is obtained from y (V) by merely appending to the 
components of y (V) one component given by (30). To complete the 
recursion for q< Ar+1 >, we note from (26) and (27) that 



<$W 






(31) 



* Note that g" ' j* 0, for otherwise the solution q of (25) is the null vector which 
cannot satisfy (26). 
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and therefore, from (29) and (30), 
1 1 . 01 + 



+ ^F^Wi" 



1 01+^2 



" gtf° T t (l - 0,) 

x [^ + (i - 0i - ft)yWi-» - (i - AMftJ (32) 

Equation (32) gives qff-f" in terms of the components of q (V) . 

3.2 Probability of transmission fault and of buffer being full 

Frequently it is adequate to determine the variation with buffer 
size of the components pf$' ) and q^ rather than of the complete dis- 
tributions p (Ar) and q ( ' V) . Notice that the probability of transmission 
fault T iN) is, by the definition given in Section I, identical to q^ ; 
and the probability that a buffer of size N is full is clearly p#° + gtf°. 
It is therefore of interest to obtain recursions for these quantities 
without having to compute the entire p and q vectors from the re- 
cursions derived in Section 3.1. 

By premultiplying eqs. (22a) and (22b) by e£(= (0, 0, • • •, 0, 1}) 
we get 

e£p = 2 e£Aq = -. — 2 —z- e£q (33) 

I — 172 



or 



i.e., 



.tt + 0-«!L * , (34) 



Pn + q N - r _ ^ i • 

It therefore suffices to obtain a recursion for T iN) . Suppressing the 
superscript (N) from (28e), and summing over the index i from k + 2 
to 2V + fc + 1, we get 

AT-HH-l 1 JV+* I _ Q _ fl 2 AT + 1 

i-t+2 1—02 .=fc+l l—t/ 2 1=2 

1 - 0! » 

- -, p L */>• (35) 

1 — »2 t=l 

Since T ( ' V) = gtf", (31) is used to relate T iIf) to {yi}. Now substituting 
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the values of \iji\ given in (28) we obtain 

1 1 _J_ 1 - 0! - 2 1 1 -fli 1 m 

JV ^ 1. (36) 
Equation (36) is the recursion quoted in Section I. 

3.3 Mean first passage time 

Let N be a positive integer and let the buffer be of size greater than 
N. Let an infinitely long burst start at t = 0, with the buffer initially 
empty, and let F (Ar) denote the mean time required for the buffer 
content to first exceed N. The manner in which F {N) depends on N 
is a useful guide in designing an adequate buffer, especially when the 
distribution of burst lengths is not accurately known. In this section 
we derive a recursive formula for F (N) , the recursion being with respect 
to the level N. 

By definition, the Nth. component of the vector ■(<) defined in eq. 
(10b) is the probability that the level N is exceeded for the first time 
at the instant t + 1. Therefore, 

/P(") = T (t + l)s N (t) 



= e£ £ (t + l)s(0- (37) 

1-0 

In the appendix we show that if X is an eigenvalue of the matrix de- 
fined in (16), then |X| < 1. This proves the convergence of the scries 
in (37). 

We proceed by obtaining an expression for £/Lo (t + l)s(i) by the 
method of generating functions. Let 

S(z) = t *' +1 s(0 (38) 



i- -.0 



so that 



and, in particular, 



S'(2) = E (<+ l)2's(0 (39) 



/-(i 



S'(D = £(*+ l)s«). (40) 

1-0 
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From the equation, (21), governing the evolution of \s{t) } we find that 

S(z) - [I - fC - 2 2 D]-M*s(0) + z*s(l) - z 2 Cs(0)}. (41) 

It is shown in the appendix that the above matrix inverse exists for 
all \z\ ^ 1. Following the procedure already outlined [eqs. (39) and 
(40)] we find that 

£(/ + l)s(0 = [I-C-D]- 1 [C+2D][I-C-D]- 1 {s(0)+s(l)-Cs(0)} 

(=0 

+ [I-C-D]-Ms(0)+2s(l)-2Cs(0)}. (42) 

The resulting expression for F (Ar) , from (37) and (42), is further 
simplified by using the following identities : 

e£ = J- 1 T [I - C - D], 

and 

V[C + 2D] = (0i + 2 ) 1 T + (1 - 02 - 20i)e£ . 

Then 

F im = ?L±Air[i _ c - D]-Ms(0) - (1 - 0i)Bs(O) + 0iBr(O)} 

+ (l r r(0) - 2 )/0i. (43) 

The above expression for F (N) holds for arbitrary initial states of the 
buffer. However, as mentioned in the beginning of this section, in 
deriving a recursive formula for F (N) we will assume the buffer empty 
at t = 0. In that case, r(0) = re and s(0) = (1 - r)e„ with re[0, 1]. 
Substituting in (43) we get, for this special case, 

2F<« = (0! + fl 2 )ir(l - C - DJ^eo + LZ f^' ( 44 ) 

We can derive a recursion for the quantity 

/ur> g ir(i _ c - D)" 1 e (45) 

from which the recursion for F (A0 will follow immediately. The pro- 
cedure is very similar to the one used to derive (36). Thus let 
x T = (xq, Xu ■ ■ • i x n) be the solution of 

(I - C - D)x = e . (46) 

Then, since l r (I - C - D) = 9&%, we get x N = l/0i. We may re- 

436 THE BELL SYSTEM TECHNICAL JOURNAL, MARCH 1 974 



place the first of the component equations in (46) by this relation. 
Exactly as in (27) and (28), we find that the components x} m (i = 0, 
■ • • , N) of the vector x (V) are, in reverse order, the first N + 1 numbers 
Xi in the sequence generated as follows : 

x o = I (47a) 

pi 

x i = v \x i - 1 , i=l,..-,k, (47b) 

1 fl . 1 - Bx - t A 1 - 0i fl ... (An , 

* m T=h*"+ i-e> *<-" ~ T^T**"- 1 ' 1>L (47c) 

Summing (47c) over i from fc + 1 to N + k + 1 and noting that 
/<"> = Ef=o x.-, we get 

f<jv+*+n _ 1 /(jv+t) _ l- g i~02 , {iV+1) _ l-0i r (A0 

; i-e* J i - 02 J i -e 2 J 

* « 1 "if. 1 fl 1 - 01 - 02 fl 

l= o l — y 2 t=o i — »2 

' (48) 



1 - 2 ' 

where the last step follows from (47a), (47b). However, 

pm = j/r^.v) _ ( T _ e 2 )/0i!/(0i + 2 ). 
Substituting in (48) we get 

Fl N+k+l) m L_ PlN+k) + j ~ 6l ~ d * FiN+l) _ l ~ dl 

r "l-0o 1-02 1-02 

+ T=£> N = 0,1,2, ■■■- (49) 

Interestingly, r does not appear explicitly in the recursion (49) ; it 
does, of course, affect the initial conditions [i. e., the values of F (0) , 
•••, F«] viaeq. (44). 

It is interesting to note that the forcing term (0i + 02)/ (1 — 02) in 
(49) can be eliminated. By direct substitution it is seen that if 0i ^ A.-0 2 
then F kN) — (0i + 9i)N/{6i — A-0 2 ) satisfies the homogeneous recursion 
(49). When 0! = A-0 2 , the same is true of F< N) - (0i+0 2 )iV 2 A(2-0i-0 2 ). 
These transformations which reduce (49) to the homogeneous form 
will be of use when we investigate the asymptotics of solutions in 
Section V. 
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IV. BURSTS WITH GEOMETRICALLY DISTRIBUTED LENGTHS 

When information is available concerning the distribution of burst 
lengths we can compute design parameters which are more realistic 
than the quantities T iN) and F lIf) discussed in the preceding sections. 
Clearly an event is of consequence only if it occurs within a burst. 
Its probability of occurrence at the tth instant must therefore be 
weighted by the probability that the burst length exceeds t. If the 
distribution of burst lengths is the weighted sum of geometric dis- 
tributions, i.e., 



j 



Prob. j Burst length = i) = £ 0*(1 - Pk )pi \ 

<t=o 

i = 1, 2, ■ • • ; < p» < 1, (50) 

then simple recursions can be obtained for such weighted averages. To 
keep the derivations simple we have only treated the case J = 1 
since, as shown in Ref. 1, generalization to higher values of J is straight- 
forward. In Sections 4.1 and 4.2 we derive such recursions for the 
probability of overflow within a burst and for the mean time to first 
cross a level within a burst. 

4.1 Overflow within a burst 

For a buffer of size greater than N let G (N) denote the probability 
that the buffer content exceeds N (at least once) during a burst. It 
is clear that G ( ' V) also equals the probability that a transmission fault 
occurs (at least once) during a burst, when the buffer size is N. We call 
G lN) the probability of overflow. 

By its definition in (10), s N (t) is the probability that the buffer 
content exceeds N for the first time at t + 1. Therefore, 

(? (Ar) = E s N (t) Prob. {burst length ^ (t + 1)1 

(=0 

= L s N (t) P < 

= e£ ± p's(fl. (51) 

(=0 

As proved in the appendix, the matrix in (16) has all its eigenvalues 
strictly within the unit circle. Therefore the series in (51) converges 
for p £ 1. 
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Multiplying (21) by p' +2 and summing over t from to » we get, 
on re-arranging terms, 

(I - P C - p 2 D) Ep's(0 = s(0) + p{s(l) - Cs(0)} 
t=o 

= [I - p(l - 0i)B]s(O) + P 1 Br(O). (52) 

In the appendix we show that (I — pC — p 2 D) is nonsingular for all 
p ^ 1. Therefore 

<?<"> = e£(I - P C - p^-^il - P (l - 0i)B}s(O) + P 0iBr(O)]. (53) 

As before, specializing to the interesting case of an initially empty 
buffer, i.e., r(0) = re , s(0) = (1 — r)e , with t in [0, 1], we get 

<JW = [(i _ T )(i _ p ) + P : ]e£(l - P C - P 2 D)^e . (54) 

We can obtain a recursion for (? (Ar) by a procedure almost identical 
to that used in obtaining the recursion for T (N) . Note that if z (N) is a 
vector such that 

(I - P C - p 2 D)z<' V) = e (55) 

then the components of the vector z {N) /z { n ) are, in reverse order, the 
first N + 1 numbers in the sequence z,-, i — 0, 1, 2, • • •, generated by 
the relations 



20 = 1 






(56a) 


1 1 






(56b) 


Zt pd-^) 2 - 1 * lf ,A!| 


i „ , p(i -fli-e 2 ). 

2 ' P (l -fl*)""- 1 ' 1 -0 2 2 *- fc 


1 - 
1 - 


-01. 

i > A.-. 


(56c) 



The first component equation in (55) then gives 

-4 = E T& N -i, N >k, (57) 

Z N i =0 

where ir , • • •, ir* are the leading (A; + 1) entries in the first row of 
(I — pC — p 2 D). (The remaining components of this row are null.) 
For N > 2k, each term on the right-hand side of (57) satisfies the 
recursion (56c). Therefore 1/zJP satisfies the same recursion. From 
(54), since G (N) is proportional to z$° we find that \/G {N) also satisfies 
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the same recursion, i.e., for N > 2k, 
1 1 1 . p(l - 0i - 6 2 ) 1 



G (N) p(1 _ 2 ) (j(jv-i) ' ! _ 2 #<*-*> 

1-02 G^-*- 1 ) K ' 

It can additionally be shown that the above recursion holds for 
2k ^ N > 1, by direct substitution of the initial values of (? (Ar) . 

4.2 Mean time for first passage within a burst 

For a buffer of size greater than N, let t denote the time required for 
the buffer content to first exceed N within a burst. Let H {N) denote 
the expectation of t conditional to the hypothesis that the level N is 
indeed exceeded within the burst. (Equivalently, H (N) is the mean 
time taken by a buffer of size N to first overflow within a burst, given 
that an overflow does occur.) Clearly 

# (Ar) = L (t + l^CO-CProb. that burst length ^ t + 1 ]/(?<*> 

f=0 



= L (< + 1)s*(0p7(7 



ov) 



= e£ £ it + lVs(0A? w . (59) 

(=0 

A comparison of (51) and (59) shows that 

ffW = | (,<?(«)._!_. (60 ) 

Multiplying (53) or (54) by p and differentiating with respect to p 
we can get closed expressions for H (N) for arbitrary initial state and for 
the buffer initially empty. The resulting expressions are rather un- 
wieldy. 

We can also use (60) to get a recursion for H {N) . Thus let 

yov) ^ — t — (qi) 

Then 



dp\VsjG« 

(62) 



^ (A 1 ) 



y(iv> ' 
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where U< N) = (d/d P )V<»\ Here V iN) satisfies the recursion (58), 
and U (N) satisfies a recursion obtained by differentiating the recursion 
for V< N K Thus 

V(A') _ 1 y(.V-l) J_ P(l - 01 - 02) y ( .v-*) _ I - 01 V (W-k-l) 

P (i-e,) x i -e 2 i-0t 

and 

/■/(AT) _ * TT(N-l) _L . (1 ~ 01 ~ 02) TT( N -k) _ 1~01 Tjtx-k-D 

P (i-e 2 ) u + p i-0, x-e t u 

! V(A') 4- (1 - 01 - 02) y (A r- fc ) /gox 

V. ASYMPTOTIC BEHAVIOR 

In this section we discuss the behavior as N — > » of sequences gen- 
erated by the recursion 

1 M (l - 0x - 2 ) 

*" " M (l - 2 ) ^ T^T 2 * N -" 

1 o 

+ i _ q VN-k-i = £n, (64) 

with N = k + 1, k + 2, • • • and < 0i < 1, < 2 < 1, and 

< n ^ 1 the parameter ranges. 

Every recursion derived in this paper can be put into the canonical 
form (64) by simple manipulations ; furthermore, all but the recursion 
(63), Section 4.2, correspond to the homogeneous form of (64), i.e., 
£at = 0. In formulas for infinitely long burst (Sections 3.1, 3.2, 3.3) 
the parameter n = 1 ; in formulas for geometrically distributed bursts 
(Sections 4.1, 4.2) < p « p < 1. 

Due to the linear, time-independent nature of the recursions in (64), 
the behavior of the solutions is determined by the sequence {£#} and 
the roots, X,, of the characteristic polynomial: 

C(X, M ) - m(1 - 2 )A* +1 - X* - m'-'U - 0i - 2 )X + m(1 - 0i)- (65) 

For the special case m = 1 the relevant properties of the roots were 
derived in Ref. 2. Here we derive the properties for arbitrary n in the 
range < m = 1- These properties are summarized in the following 

Lemma: For the range of parameters specified above, (a) C(X, n) has ex- 
actly two positive real zeros Xi and Xo which lie in the ranges [_n(l — 00] 
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Fig. 2 — Proof of lemma. 

< (Xi)* ^ /x and 1/m ^ X 2 < 1/m(1 - ^2) (i/te equality signs are un- 
necessary unless p = 1); (&)* Me remaining zeros all satisfy |X,-|* < m- 

Proof: (a) Regardless of the sign of (1 - 0i - 2 ) there are two sign 
reversals in the coefficients of C(X, n). By Descartes' rule, therefore, 
C(X, m) has at most two positive real zeros. On the other hand, suc- 
cessively setting X = 0, X fc = /x(l - 0i), X fc = n, X = l/>, X = 1/ 
m(1 — 02) we find that C(X, /x) takes on the respective values m(1 — 0i), 
M 2 0i02[M(l-0!)] 1/fc , -/x0i(l-M ( * +1>/ *), -02(M" fc -M), and M 0i02/(l-02). 
Also C(X, m) — > + °° as X — > + 00 . For < v < 1, therefore, there are 
exactly two zeros in the respective ranges asserted. For n = 1 further 
examination is required to decide whether one or both of these zeros 
become exactly equal to 1. Noticing that C(l, 1) = and (d/dX) 
C(l, 1) = 0i - kd 2 , it follows that when p = 1, either X x or X 2 or both 
become equal to 1 according as 0i - fc0 2 <0, >0, or =0. (b) We 
will prove the stronger result that the remaining zeros lie strictly 
within the contour r (Fig. 2) defined by the following segments in the 
complex X plane: 



X = Re**'** 


^ R ^ n 1 "* 


(66a) 


= ^Ik e i9 


s*'*»-i 


(66b) 


_ J^ e -i(2ir-ir/fc) 


^ # ^ M l/fc - 


(66c) 


To prove this let us define 






C, = /xX[(l - 2 )X* 


- M (l - 0i - S )] 


(67a) 


C 2 = X* - M (l - h) 




(67b) 



* We are tacitly assuming fc > 1. For k = 1, C(X, m) becomes a quadratic with 
both roots positive and real in the ranges given in (a). 
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so that 

C(X, M ) =Ci-C, 



-c(g-l)- (68) 



We will show that Re[Ci/C 2 — lj < for all X on the contour r. 
Then by an obvious modification of Rouche's theorem, 10 it follows that 
C(X, /x) and C 2 each have the same number of zeros within I\ As C 2 
has k — \ zeros within T, this proves the lemma. 

To show that Re (Ci/C 2 — 1) < for all X on r, let us consider 
separately the circular arc defined by (66b) and the radial lines defined 
by (66a) and (66c). 

(i) On the circular arc (66b) straightforward manipulation gives 

I d | 2 — M 2+2/fc |C' 2 | 2 

= - 20 2 m 2 (2 - 0i - 2 )(1 - cos kd) S 0. (69) 

For/x < 1, therefore, \Ci/C 2 \ < 1, hence Re (Ci/Cj - 1) < 0. 
If n = 1, this argument remains valid except at points where 
cos kd = 1, for then \Ci/C 2 \ = 1. However, if cos &0 = 1 and 
H = 1, we find that Ci/C 2 — 1 = e ifl — 1, whose real part 
<0 for ir/k ^ 6 ^ 2tt - t/A;. 
(m) On the radial lines (66a) and (66c), 

■' ji ( i -'-- «' + 'Si'-i J H- 1 ' (70) 

which is obviously <0 for R k ^ /x. 

All the recursions of this paper except (63) correspond to the homo- 
geneous form of (64), i.e., £, = 0. Solutions of all such recursions are of 
the form 

<p N = i. p*?, (7D 

1=0 

and therefore the asymptotic behavior is governed by X 2 , and Xi 
when it is equal to 1. (In the special case p = 1 and 0i = /c0 2 , the 
dominant root is repeated and the usual modification must be made.) 
Dropping the subscript i from X, and /3, we give below an expression for 
the latter in terms of the initial conditions of the recursion, namely 
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Re 



(<Po, • ■ ■ , Vk) : 

where 

a = P (l - ft)X*+V[X* + /cp 2 (l - ft - ft) - (A; + 1)p(1 - ft)]. (72b) 

Thus, for example, the recursion for the probability of overflow 
[eq. (58)], with r = 0, in the canonical form (64) has the initial 
conditions <p = 1, <p t = 1/[p(1 — ft)]*, i = 1, 2, ■ • •, fc. Also, in this 
case the dominant root of the characteristic polynonial X 2 is the only 
root outside the unit circle in the complex plane. Therefore, 

/3Ar, (73) 



(?<"» 



where /3 is obtained from (72) for the appropriate values of <p a , • • • , <Pk- 
It can be easily shown that /3 > 0. In (73) (and similarly throughout 
this section) we use the notation l/G (N) ~ jSX^ to mean that | l/G im 
— fl\%\ < e N , for sufficiently large N, and e < 1. 

In a manner similar to the derivation of (73) we can show that the 
probability of a transmission fault (Section 3.2) has the following 
asymptotic behavior 

^~°M + j?=W t whenft<fcft (74a) 

' 1_Ml when ft > /eft. (74c) 



h - fcft 



In (74), ai is obtained from the generic formula (72a). We have shown 
that ai > and, of course, 1 < X 2 < 1/1 — ft- Likewise, the mean 
first passage time (see Section 3.3) is, asymptotically, 

FW ~ a 2 X 2 v - (^ + e *l N a 2 > 0, when ft < /eft 

/Cft — ft 

~ Jo'V'^ + ««* + « 4| when ft = fcft 

_ (ft + ftjjv when , > ^ 2 

ft — fcft 
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Finally, 



HW ~a t + a 1 N, a 7 > 0. 



(76) 



VI. COMPUTATIONS 

We have written computer programs to recursively compute the 
quantities T lN) , F {N) , G iN) , H (N) as functions of N for specified values 
of 0i, 2 , k, and p. Figures 3 through 6 are sample illustrations generated 
by these programs for 0i = 0.2 and 2 = 0.1. The asymptotic behavior 




Fig. 3 — Probability of overflow in a burst vs level (0i = 0.2, 2 = 0.1, k = 5). 
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Fig. 4 — Mean time for first passage conditional on overflow vs level (0i = 0.2, 
h = 0.1, k = 5). 
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Fig. 5 — Steady-state probability of transmission fault vs buffer size (0i = 0.2, 
t = 0.1). 




Fig. 6— Mean time for first passage in infinitely long bursts (0i = 0.2, 6i =0.1). 

of the various quantities is seen to be in accord with that given by 
eqs. (73)- (76) of the previous section. The dependence on the param- 
eters p and k also is intuitively reasonable. 

APPENDIX 

(a) We prove the assertion made in the text [immediately following 
eq. (37)] that the eigenvalues of the matrix (16) all lie strictly within 
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the unit circle. Let 

a[ a -bob -XI 6 2 A "I 

L 9iB Q-0 2 )A-XlJ' KU) 

where I is the identity matrix of order N + 1. Then we must show that 

detM 9*0, for |X| £ 1. (78) 

From the defining equations (14) and (18), we notice that the last 
column of A is identically zero. Thus 

detM = - XdetM', (79) 

where M' is obtained from M by deleting its last row and column. Let 
m <i) h 3 — 0| ' ' •» 2N + 1, denote the elements of M'. Then a theorem 
of Hadamard 11 states that det M' 9* provided M' is irreducible and 

2AT+1 

\ma\ ^P } = L \m i} -\, (80) 

for all j, with strict inequality for at least one j. The irreducibility 
condition as stated in Ref. 11 is satisfied. To show (80) we note that 

|m„| = |X| andP, = 1, for j = 1, ■ ■ ■, 2N + 1, (81) 

and 

I moo I = 1 1 - 0i - X | , P = 0i. (82) 

Thus except at X = 1, we find that (80) is true with strict inequality 
for j = 0. This proves the assertion (78) except for the point X = 1. 
However, for X = 1, det M = 0i(l — #2)^ which, by assumption, ?*0. 
(b) Following eq. (52) we made the assertion that I — pC — p 2 D is 
a nonsingular matrix for p ^ 1. The proof is as follows. Let 

m = [m;;m;;]. « 

with M u = (1 — 0i)B — XI, M 2 i = 0iB, etc. As M 2 i commutes with 
Mn, an identity of Schur 12 states that 

det M = det [M U M 22 - M 21 Mi 2 ]. (84) 

However, straightforward manipulation of the right side of (84) shows 
that 

det M = det (X 2 I - XC - D). (85) 

Then the assertion follows from (78). 
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